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Box Patent Application 

Assistant Commissioner for Patents ^ 
Washington, D.C. 20231 m .?j* 

NEW APPLICATION TRANSMITTAL ^ 

in 0 
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Transmitted herewith for filing is the patent application of * n 
Inventory): Jarno KNUUTILA; Jari TOIVANEN; Janne JUHOLA; Markku LIPPONEN; Ari AHO; 
Janne HAAVISTO; Kaj SAARINEN 
WARNING: 37 C.F.R. § 1.41(a)(1) points out: 

'(a) A patent is applied for in the name or names of the actual inventor or inventors, 

*(1) The inventorship of a ncnprovisicnal application is that inventorship set forth in the oath or 
declaration as presented by § 7.53, except as provided for in § 1.53(d)(4) and § 1.63(d). If an 
oath or declaration as prescribed by § 1.63 is not filed during the pendency of a nenprcvisicnaf 
application, the inventorship is that inventorship set forth in the application papers fifed pursuant 
to § 1.53(b), uniess a petition under this paragraph accompanied by the fee set forth in § 1.17(f) 
is filed supplying or changing the name or names of the inventor or inventors. m 



For (title): 



METHOD FOR TRANSFERRING IMAGE INFORMATION 



CERTIFICATION UNDER 37 C.FJL 1.10* 
(Express Mail label number is mandatory.) 
(Express Mail certification is optional.) 

I hereby certify that this New Application Transmittal and the documents referred to as attached therein are being 

deposited with the United States Postal Service on this date January 19. 1999 ; n an envelope 

as -Express Mail Pest Office to Addressee," mailing Label Number EL067101068US ad- 
dressed to the: Assistant Commissioner for Patents, Washington, D.C. 20231. 

Elaine Mian 



{type or print name of person mailing paper) 



Signature of person mailing paper 

WARNING: Certificate of mailing (first class) or facsimile transmission procedures of 37 C.F.R. 1.3 cannot be 
used to obtain a date of mailing or transmission for this correspondence. 

*WAPNING: Each paper or fee filed by 'Express Mail" must have the number of the 'Express Mail' mailing label 
placed thereon prior to mailing. 37 C.F.R 1. 10(b). 

'Since the filing of correspondence under § 1.10 without the Express Mail mailing label thereon 
is an oversight that can be avoided by the exercise of reasonable care, requests for waiver of this 
requirement will not be granted on petition. ' Notice of Get 24, 7995. 60 Fed. Reg. 56,439, at 56, 442. 
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1- Type of Application 

This new application is for a(n) 

(check one applicable item below) 

£3 Original (nonprovisionai) 

□ Design 
□ Plant 

WARNING: Do not use this transmittal for a completion in the U.S. of an International Application under 35 
U.S.C. 371(c)(4), unless the International Application is being filed as a divtsionai, continuation or 
continuation-in-part application. 

WARNING: Do not use this transmittal for the filing of a provisional application. 

NOTE: If one of the following 3 items aopiy, then complete and attach ADDED PAGES FOR NEW APPLICATION 
TRANSMITTAL WHERE 3ENEFFT OF A PRIOR U.S. APPLICATION CLAIMED and a NOTIFICATION 
IN PARENT APPLICATION OF THE RUNG OF THIS CCNVNUATION APPLICATION. 

□ Divisional. 

□ Continuation. 

□ Continuation-in-part (C-I-P). 

2, Benefit of Prior U.S. Application(s) (35 U.S.C. 119(e), 120, or 121) 
NOTE: A nonprovisionai application may claim an invention disclosed in one or more prior filed copending 
nonprovisionai applications or copending intemationai applications designating the United States of 
Amenca. In order for a nonprovisionai application to claim benefit of a prior filed copending 
nonprovisionai application or copending intemationai application designating the United States of 
Amenca, each pnor application must name as an inventor at least one inventor named in the iatsr filed 
nonprovisionai application and disclose the named inventor's invention claimed in at least one claim 
of the later filed nenprcvisicnai application in ±e marker provided by the first paragraph of 35 U.S.C. 
T 72. Each prior application must also be: 

(J) An intemationai application entitled to a filing date in accordance with POT Article 11 and 
designating the United States of Amenca; cr 

(it) Complete as set forth in § 1.51(b); or 

ffii) Entitled to a filing date as set forth in § 1.53(b) or § 1.53(d) and include the basic Wing fee set 
forth in § 1.16; or 

(iv) Entitled to a filing date as set forth in § 1.53(b) and have paid therein the processing and retention 
fee set forth in § 121(f) within the time penod set forth in § 1.53(f). 

37 O.F.R. § 1.78(a)(1). 

NOTE: If the new application being transmitted is a divisional, continuation or a continuation-in-part of a parent 
case, or where the parent case is an Intemationai Application which designated the U.S., or benefit 
of a prior provisional application is claimed, then check the following item and complete and attach 
ADDED PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U S APPLICA- 
TION^) CLAIMED. 

WARNING: If an application claims the benefit of the filing date of an earlier filed application under 35 U.S.C. 

120, 121 or 365(c), the 20-year term of that application wilt be based upon the filing date of the 
earliest U.S. application that the application makes reference to under 35 U.S.C. 120, 121 or 365(c). 
(35 U.S.C. 154(a)(2) does not take into account, for the determination of the patent term, any 
application on which prionty is claimed under 35 U.S.C. 119, 365(a) or 365(b).) For a c-*-p 
application, applicant should review whether any claim in the patent that will issue is supported 
by an earlier application and, if not, the applicant should consider canceling the reference to the 
earlier filed application. The term of a patent is not based on a daim-by-claim approach. See Notice 
of Apni 14, 7995, 50 Fed. Reg. 20,195, at 20,205. 
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WARNING: When the last day of pendency of a provisional application fails on a Saturday, Sunday, or Federal 
holiday within the District of Columbia, any nonprovisionaJ application claiming benefit of the 
provisional application must be filed pnor to the Saturday, Sunday, or Federal holiday within the 
District of Columbia. See 37 C.F.R § 1.7B(a)(3). 

□ The new application being transmitted ciaims the benefit of prior U.S. applica- 
tion®. Enclosed are ADDED PAGES FOR NEW APPLICATION TRANSMITTAL 
WHERE BENEFIT OF PRIOR U.S. APPLICATIONS) CLAIMED. 

I- Papers Enclosed 

A. Required for filing date under 37 C.F.R. § 1.53(b) (Regular) or 37 C.F.R. § 1.153 
(Design) Application 

if! — Pages of specification 

— — Pages of ciaims 

— 4__ Sheets of drawing 

WARNING: DO NOT submit original drawings. A high qualiP/ copy of the drawings should be supplied when 
filing a patent application. The drawings that are submitted to the Office must be on strong, white, 
smooth, and non-shiny paper and meet the standards according to § 1.34. If corrections to the 
drawings are necessary, they should be made to the ongmal drawing and a high-quality copy of 
the corrected original drawing then submitted to the Cffice. Only one copy is required or desired. 
For comments on proposed then-new 37 CFR 1.34, see Notice of March 9, 198$ (199Q O.G. 57-621 

NC 7c: "Identifying indicia, if provided, should include the application number or the title of the invention, 
inventor's name, docket number [if any), and the name and telephone numoer of a person to call ,f 
the Cffice is unabie to match the drawings to the proper application. This infcnr.avon should be placed 
on the back of each sheet of drawing a minimum distance of 1.5 cm. (5/8 incn) down from the top 
of the page . . 37 C.F.P.. 1.34(c)). 

(complete the following, if applicable) 

□ The enclosed drawing(s) are photcgraph(s), and there is also attached a 
"PETITION TO ACCEPT PHOTOGRAPH(S) AS DRAWING(S)," 37 C.F.R. 1.84(b). 

□ formal 

□ informal 

B. Other Papers Enclosed 

— *L Pages of declaration and power of attorney 
— L Pages of abstract 
Other 



4. Additional papers enclosed 

□ Amendment to ciaims 

□ Cancel in this applications claims before 

calculating the filing fee. (At least one original independent claim must be 
retained for filing purposes.) 

□ Add the ciaims shown on the attached amendment. (Claims added have 
been numbered consecutively following the highest numbered original 
claims.) 

x £5 Preliminary Amendment 

£9 Information Disclosure Statement (37 C.F.R. 1 .98) 
[3 Form PTCM449 (PTO/SB/G8A and 08B) 
0 Citations 
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□ Declaration of Biological Deposit 

□ Submission of "Sequence Listing," computer readable copy and/or amendment 
pertaining thereto for biotechnology invention containing nucleotide and/or 
amino acid sequence. 

□ Authorization of Attcmey(s) tc Accept and Fciiow Instructions from Representa- 
tive 

□ Special Comments 

□ Other 

5. Declaration or oath (including power of attorney) 

NOTE: A newty executed declaration is not required in a continuation or divisional application provided that 
the pnor nonprovisicnaJ application contained a declaration as required, the application being filed is 
by ail or fewer than ail the inventors named in the pnor application, there is no new matter in the 
application being filed, and a copy of the executed declaration filed in the pnor application (snowing 
the signature or an indication therecn that it was signed) is submitted. The ccoy must be accompanied 
by a statement requesting deletion of tf?e names of perscn(s) wno are not inventors of tine application 
being filed. If the declaration in the prior application was filed under § 1.47, then a copy of that 
declaration must be filed accompanied by a ccoy of the decision granting §1.47 status or, if a ncnsignmg 
person under § 1.47 has subsequently joined tn a pnor application, then a copy of the subsequently 
executed declaration must be filed. See 37 CF.R. §§ 1.63(d)(1H3). 

NOTE: A declaration filed to complete an aacticatcn must be executed, identify the specification to wmcn it m 
is directed, identify each inventor by full name including family name and at least one given name, without 
abcreviaticn together with any other given name or initial, and the resicence, pest office adcress and 
oountry or citizenship of eacn inventor, and state wnether the inventor is a sole or joint inventor. 37 
CF.R. § 1.63(a)(1)-{4). 

£3 -Enclosed- . 
Executed by 

(check ail acciicable bcxes) 

£2 inventors). 

□ legal representative of inventor(s). 
37 CFR 1.42 or 1.43. 

□ joint inventor or person showing a proprietary 
interest on behatf of inventor who refused to sign 
or cannot be reached. 

□ This is the petition required by 37 CFR 1 .47 and the statement 
required by 37 CFR 1.47 is also attached. See item 13 beiewfer 
fee. 

□ Not Enclosed. 

NOTE: Where the filing is a completion in the U.S. of an International Application or where the completion of 
the U.S. application contains subject matter in addition to the International Application, the application 
may be treated as a continuation or continuation-in-part, as the case may be, utilizing ADDED PAGE 
FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. APPLICATION CLAIMED. 

□ Application is made by a person authorised under 37 C.F.R. 1 .41 (c) on benalf 
of all the above named inventor(s). 

(The declaration or oath, along with the surcharge required by 37 CFR 1.16(e) 

can be filed subsequently). 

□ Showing that the filing is authorized. 

(not required unless called into question. 37 CFR 1.41(d)) 
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6. Inventorship Statement 

WARNING: If the named inventors are each not the inventors of ail the claims an explanation, inducing the 
ownership of the various daims at the time the last claimed invention was made, should be 
submitted. 

The inventorship for ail the claims in this application are: 

□ The same. 

or 

□ Net the same. An explanation, -including the ownership of the various claims at 
the time the last claimed invention was made, 

□ is submitted. 

□ will be submitted. 

7. Language 

NOTE; An application induding a signed oath or declaration may be filed in a language other than English. 
An English translation of the non-Engiish language aooiication and the processing fee of$130.0Q 
required by 37 CFR 1.17(h) is required to be filed wtth the application, or within such time as may be 
set by the Office. 37 CFR 1.52(c). 

5ot English 

□ Non-English 

□ Tne attached translation includes a statement that the translation is accu- 
rate. 37 C.F.R. 1.52(d). 

8. Assignment 

Q< An assignment of the invention to Nokia Mobile Phones Ltd. 



SX is attached. A separated "COVER SHEET FOR ASSIGNMENT (DOCU- 
MENT) ACCOMPANYING NEW PATENT APPLICATION" or □ FORM PTO 
15S5 is also attached. 

□ will follow. 

NOTE: "If an assignment is submitted 'with a new application, send two separate letters-one for the application 
and one for the assignment * Notice of May 4, 1990 (1 1 14 O.G. 77-73). 

WARNING: A newly executed "CERTIFICATE UNDER 37 CFR 3. 73(b)" must be filed when a continuation-in-part 
application is filed by an assignee. Notice of April 30, 1993, 1150 O.G. 62-64. 
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9, Certified Copy 

Certified copy(ies) of application(s) 



Country 


Appin. No. 


Red 


Finland 


980150 


23 January 1998 


Country 


Appln. No. 


Red 


Country 


Appin. No. 


Red 



from which priority is claimed 
0 is (are) attached. 
□ will follow. 

NOTE The foreign application forming the basis for the claim for priority must be referred to in the oath or 
declaration. 37 CFR 1.55(a) and 1.63. 

NOTE: This item is for any foreign pncnty for which the application being filed directiy relates. If any parent 
US. application or International Application from which this application daims benefit under 35 U.S.O 
120 is itself entitled to prionty from a pnor foreign application, then complete item 18 on the ADDED 
PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR US. APPLICATION^) 
CLAIMED. 

10. Fee Calculation (37 C.F.R. 1.16} 
A. IB Regular application 



CLAIMS AS FILED 


Number filed 


Number Extra 


Rate Basic Fee 

37 C.F.R. 1.16(a) 
$760.00 


Total 

Claims (37 CFR 1.16(c)) 14 - 


20 = Ox 


S 18.00 


Independent 

Claims (37 CFR 1.16(b)) 3 - 


3 = ox 


S 78.00 


Multiple dependent c!aim(s) t 
if any (37 CFR 1.16(d)) 




$ 260.00 



□ Amendment cancelling extra claims is enclosed. 

Q Amendment deleting multiple-dependencies is enclosed. 

□ Fee for extra claims is not being paid at this time. 

NO TE: If the fees for extra claims are not paid on filing they must be paid or the daims cancelled by amendment 
prior to the expiration of the time penod set for response by the Patent and Trademark Office in any 
notice of fee defidency. 37 CFR 1.16(d). 

Filing Fee Calculation S 760.00 

B. □ Design application 

($310.00-37 CFR 1.16(f)) 

Filing Fee Calculation $ 

C. □ Plant application 

(S 480. 00— 37 CFR 1.16(g)) 

Filing fee calculation $ 
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11. Small Entity Statement(s) 

□ Statement(s) that this is a filing by a small entity under 37 CFR 1 .9 and 1 .27 
is (are) attached. 

WAPNING: 'Status as a smalt entity must be specifically established in each application or patent in which 
the status is available and desired. Status as a small entity in one application or patent does net 
affect any other application or patent, including apclications or patents which are direciiy or 
incirectiy dependent upon the apclicaticn or patent m which the status has been established. Tne 
refiling of an apciication under § 1.53 as a continuation, division, or continuaticn-in-part (including 
a continued prosecution application under § 1.53(d)), or the filing of a reissue application requires 
a new determmaticn as to continued entitlement to small entity status for the continuing or reissue 
application. A ncnprovisional application claiming benefit under 35 U.S.C. 119(e), 120, 121, or 
365(c) of a pner apclicaticn, or a reissue application may rely on a statement filed In the pner 
acciicaticn or in the patent if the ncnprovisional acclication or the reissue application includes a 
reference to the statement in the pner application cr in the patent or includes a copy of the 
statement in the pner apclicaticn or in the patent and status as a small entity is still proper and 
desired. The payment of the small entity basic statutory filing fee will be treated as sucn a reference 
for purposes of this section.* 37 C.F.P. § 1.23(a)(2). 

(complete the following, if applicable) 

□ Status as a small entity was claimed in pricr application 

/ , filed cn , from which benefit 

is being claimed fcr this apclicaticn under 

35 U.S.C, □ 119(e), 

□ 120, 

□ 121, 

□ 365(c), 

_ and which status as a small entity is stiil proper and desired. 
□ A copy cf the statement in the phcr apclicaticn is included. 
Fling Fee Calculation (5C% cf A, 5 cr C above) 

S 

NC TE; Any excess of the full fee paid will be rerun dec if small entity status is established and a refund request 
are filed within 2 months of the date of timely payment of a full fee. Tne two-month penod is not 
extendaoie under § 1.136. 37 CFR 1.23(a). 

12. Request for International-Type Search (37 C.F.R. 1.104(d)) 

(complete, if applicable) 

G Please prepare an intematicnal-type search report fcr this application at the time 
when national examination on the merits takes place. 
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13. Fee Payment Being Made at This Time 

□ Not Enclosed 

□ No filing fee is to be paid at this time. 

(This and the surcharge required by 37 C.F.R. 1.16(e) can be paid subse- 
quently.) 

ffl Enclosed 

□ Filing fee S 760 * 0Q 

(5 Recording assignment 
($40.00; 37 C.F.R. 1.21(h)) 
(See attached "COVER SHEET FOR 
ASSIGNMENT ACCOMPANYING NEW 

APPLICATION".) S 



□ Petition fee for filing by other than ail the 
inventors or person on behalf of the inventor 
where inventor refused to sign or cannot be 
reached 

($1 30.00; 37 C.F.R. 1.47 and 1.17(0) S 

□ For processing an application with a 
specification in 

a non-English language 

($130.00; 37 C.F.R. 1.52(d) and 1.1 7(k)) S 

□ Processing and- retention- fee 

" {$130.00; 37 C.F.R. 1.53(d) and 1.21(1)) $ 

□ Fee for intematicnal-type search report 

($40.00; 37 C.F.R. 1.21(e)) $ 



NOTc: 37 CFR 1.21 (J) establishes a fee for processing and retaining arty application that is abandoned for failing 
to complete the application pursuant to 37 CFR 1.53(f) and this, as well as the changes to 37 CFR 7.53 
and 1. 78(a)(1), indicate that in order to obtain the benefit of a prior U.S. application, either the basic 
filing fee must be paid, or the processing and retention fee of § 1.21(1) must be paid, within 1 year from 
notification under § 53(f). 

Total fees enclosed S 800 ' 00 

14. Method of Payment of Fees 

Q Check in the amount of & 800.00 



□ Charge Account No. in the amount of 

$ 

A duplicate of this transmittal is attached. 

NOTE: Fees should be itemized in such a manner that it is dear for which purpose the fees are paid. 37 CFR 
1.22$). 
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5. Authorization to Charge Additional Fees 

WARNING: If no fees are to be paid on filing, the following items should not be completed. 

WARNING: Accurately count daims, especially multiple dependent claims, to avoid unexpected high charges, 
if extra daim charges are authorized. 

Qfl The Commissioner is hereby authorized to charge the following additional fees 
by this paper and during the entire pendency of this application to Account No. 
16-1350 * 

S3 37 C.F.R. 1.16(a), (f) or (g) -(filing fees) 

B 37 C.F.R. 1.16(b), (c) and (d) (presentation of extra claims) 

NOTE: Because additional fees for excess or multiple dependent daims no t paid on filing or on later presentation 
must only be paid or these daims cancelled by amendment prior to the expiration of the time period 
set for resccnse by the PTO in any notice of fee deficiency (37 OPR 1. 16(d)), it might be best not to 
authorize the PTO to charge additional daim fees, except possibly wnen dealing with amendments after 
final action. 

12 37 C.F.R. 1.16(e) (surcharge fcr filing the basic filing fee and/cr declaration 
cn a date later than the filing date of the application) 

E 37 C.F.R. §§ 1.17(a)(1H5) (extension fees pursuant to § 1.136(a)). 

□ 37 C.F.R. 1.17 (application processing fees) 

NOTE: . A wntten request may be submitted in an application that is an authorization to treat any concurrent 
or future reply, requinng a petition for an extension of time under this paragraph for its timely sucmtssion, 
as incorporating a petition for extension of time for the appropriate length of time. An authonzation to 
charge ail required fees, fees under § 1.17, or all required extension of time fees will be seated as a 
ccnstructi*/e petition fcr an extension of time in any concurrent or future reply requiring a petition for 
an extension of time under this paragrach for its timely submission. Submission of the fee set forth in 
§ 7. 1 7(a) will also be treated as a construcsve petition fcr an extension of time in any concurrent reply 
requinng a petition for an extension of time under this paragrach for its timely submission. " 37 C.f.P. 
§ 1.136(a)(3). 

□ 37 C.F.R. 1.13 (issue fee at or before mailing of Notice of Allowance, 
pursuant to 37 C.F.R. 1.311(b)) 

NOTE: Where an authonzation to cnarge the issue fee to a deposit account nas seen filed before £e mailing 
of a Notice of Allowance, the issue fee will be automatically cnarged to the deposit account at the time 
of mailing the notice of allowance. 37 OPR 1.311(b). 

NOTE: 37 CPR 1.23(b) requires 'Notification of any change in status resulting in loss of entitlement to small 
entity status must be filed in the application . . . pnor to paying, or at the time of paying, . . . the issue 
fee. . . .'From the wording of 37 OPR 1.23(b), (a) notification of change of status must be made even 
if the fee is paid as "other than a small entity" and (b) no notification is required if the change is to 
another small entity. 
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16. Instructions as to Overpayment 



NOTE: m . . . Amounts of twenty-five dollars or less wilt net be returned unless specifically requested within 
a reasonable time, nor will the payer be notified of such amounts: amounts over twenty-five dollars may 
be returned by check or, if requested, by credit to a deposit account.' 37 C.F.R. § 1.26(a). 

□ Credit Account No. 16 " 135Q 

□ Refund 



SEND ALL CORRESPONDENCE TO: 



Reg. No. 24,622 



Tel. No. (203 ) 259-1800 



Customer No. 




SlSKAftlRE OF PRA< 

Clarence A, Green 



{type or print name of attorney) 
PERMAN & GREEN, LLP 



P.O. Address 
425 Post Road 
Fairfield, CT 06430 
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Incorporation by reference of added pages 

(check the following item if the application in this transmittal claims the benefit of 
prior U.S. applications) (including an international application entering the U.S. 
stage as a continuation, divisional or C-/-P application) and complete and attach 
the ADDED PAGES FOR NE/V APPLICATION TRANSMITTAL WHERE BENEFIT OF 
PRIOR U.S. APPLICATION^) CLAIMED) 

□ Plus Added Pages for New Application Transmittal Where Benefit of Prior U.S. 
Application(s) Claimed 

Number of pages added 

□ Plus Added Pages for Papers Referred to in Item 4 Above 

Number of pages added 

□ Pius added pages deleting names of inventors) named in prior application(s) 
who is/are no longer inventors) of the subject matter claimed in this application. 

Number of pages added 

□ Plus "Assignment Cover Letter Accompanying New Application" 

Number of pages added 

Statement Where No Further Pages Added 

(if no further pages form a part of this Transmittal, then end this Transmittal with 
this page and check the following item) 
E This transmittal ends with this page. 
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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Express Mail No. : EL067 1 0 1 068US 

In re Application of: KNUUTILA et al. 

SERIAL NUMBER: EXAMINER: 

FILING DATE: Herewith ART UNIT. 

TITLE: METHOD FOR TRANSFERRING IMAGE INFORMATION 

ATTORNEY DOCKET NO.: 460-008437-US(PAR) 

The Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

PRELIMINARY AMENDMENT 

Dear Sir: 

Please amend the above-identified, enclosed patent application as follows: 
IN THE CLAIMS: 

Please amend Claims 4, 6, 10 and 12 as shown below. 
Claim 4, line 1, delete "or 3". 
Claim 6, line 1, delete "or 5". 
Claim 10, line 1, delete "or 9". 



Claim 12, line 1, delete "any of the claims 8 to 1 1" and insert —claim 8—. 



2 



REMARKS 



Prior to calculation of the fees, please enter this preliminary amendment. 



RespectfuiHy>subnTitted, 




Clarence A. Green, Reg: No. 24,622 
PERMAN & GREEN, LLP 
425 Post Road 
Fairfield, CT 06430 
(203) 259-1800 
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Date 
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Method for transferring image information 



The present invention relates to a method for transferring image infor- 
5 mation according to the preamble of the appended claim 1 , a camera 
module according to the preamble of the appended claim 7, and a 
mobile station according to the preamble of the appended claim 13, 

In digital cameras and video cameras, an optical image is converted 

10 into electrical form by an image sensor, typically a charge coupled de- 
vice (CCD). Such an image sensor consists of several photosensitive 
picture elements (pixels) which are arranged advantageously in a ma- 
trix form. The number of pixels in the image sensor affects the resolu- 
tion of the image to be formed. Typically, the image sensor used in 

15 cameras and video cameras consists of hundreds of thousands of pix- 
els, for example 640 x 480 = 307 200 pixels. In a CCD sensor, light in- 
duces a charge in the pixel, which is affected e.g. by the intensity of the 
light as well as the time of action of light in the pixel, i.e. exposure time. 
Cameras are equipped with optics whereby the image is focused at the 

20 pixels of the image sensor. When a CCD sensor is used, the pixels are 
uncharged before taking the picture, whereby after a predetermined 
exposure time, each pixel has a charge which is proportional to the 
quantity of light directed to it and which can be measured. After the ex- 
posure, the entry of light in the CCD sensor is prevented e.g. with a 

25 mechanical shutter. The shutter function can be implemented also 
electrically by sufficiently quick reading of the image sensor. 

In the CCD sensor, the pixels are chained by coupling them in series, 
and the output of the CCD sensor is coupled with the first pixel in the 

30 connection in series, whereby the image signal from the CCD sensor 
can be read by transferring charges from one pixel to the next, timed by 
a charge transfer signal. The charges can be read from the output of 
the CCD element, whereby the charge of the pixel coupled to the output 
is read first. In the same connection, the charge transfer signal induces 

35 the transfer of charges in other pixels to the next pixel, i.e. the pixel 
coupled to the output will receive the charge of the second pixel 
coupled to the same, the second pixel will receive the charge of the 
pixel that is third in the connection in series, respectively, etc. Each line 



2 



of the image sensor can form a separate pixel chain. Each pixel chain 
is provided with a separate output from the first pixel in the chain, as 
presented above. From these outputs from the pixel chains, the 
charges can be transferred e.g. to a transfer register. Reading a CCD 

5 image sensor formed in this way requires transfers of charges in a way 
corresponding to the number of pixels in the pixel chain. Thus, measur- 
ing the charge of a single pixel is not possible except by carrying out 
the transfer of charges as presented above as long as the charge of the 
desired pixel is in the output of the image sensor. Using such an image 

10 sensor, undersampling of the image is difficult and slow because, in 
practice, the charges of all pixels in the pixel chain must be transferred 
to the output even though some of the pixels were not processed in un- 
dersampling. 

15 The conversion of an analog signal generated by the image sensor to 
digital form can be conducted with an analog/digital converter. The 
conversion accuracy of the analog/digital conversion is typically 8 bits, 
whereby 256 luminous intensity levels are obtained from each pixel. 
Considering the capacity of human eye, this number is usually sufficient 

20 to provide the required image quality. From the analog/digital converter, 
this conversion result is transferred in parallel form for further 
processing steps, such as for storing in an image memory or on a video 
tape. In digital cameras and video cameras of prior art, the display de- 
vice used is an analog display device, such as a LCD display device 

25 equipped with an analog connection, whereby the image is transferred 
as an analog signal to the display device. 

In addition to the above-mentioned CCD sensors, recent development 
has involved so-called CMOS image sensors, whereby it is also 
30 possible to conduct the photoelectric conversion of the image. These 
CMOS image sensors are based on primarily two different operating 
principles: integrating and non-integrating image sensors. 

In integrating image sensors, the current generated by the pixel is used 
35 to charge a capacitor arranged in connection with the pixel. The charge 
of the capacitor depends on the strength and charge time of the current 
induced by the pixel. Before image formation, each capacitor is un- 
charged, after which the current generated by the pixel starts to charge 
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the capacitor, whereby the charge accumulated in the capacitor after 
the exposure is proportional to the quantity of light to which the pixel 
was exposed. Setting the exposure time of integrating CMOS image 
sensors can be handled e.g. by a mechanical shutter, whereby the 

5 control electronics can be made simpler whereby the exposure time of 
each image element is substantially the same, or by timing the 
discharging of the capacitor and measuring of the accumulated charge 
substantially the same for different pixels. In an integrating image 
sensor, a charge is also accumulated in the capacitor when the pixel is 

10 in darkness. This may distort the image signal from the pixel. To correct 
this, a so-called correlated double sampling (CDS) method has been 
developed, whereby the charge of the capacitor of the pixel is meas- 
ured after charge resetting preferably before exposure, and this value is 
stored for each pixel. The charge of the capacitor is measured again 

15 after the exposure time, and the stored value is subtracted from this 
measurement value. The difference corresponds better to the real 
image signal proportional to the quantity of light than an image signal 
obtained by one measurement. After the charge measurements pre- 
sented above, the measurement value is subjected to analog/digital 

20 conversion, whereby the measurement result can be stored in digital 
form. 

In non-integrating CMOS image sensors, the current generated by each 
pixel is measured, which is proportional to the intensity of light to which 
25 the pixel is exposed at the time. This kind of a sensor has the advan- 
tage that each pixel can be designated separately and the current can 
be measured irrespective of other pixels and exposure times. This ran- 
dom access is easier in integrating image sensors, if a mechanical 
shutter is used to set the same exposure time for different pixels. 

30 

CMOS image sensors can be also divided into passive and active im- 
age sensors. Their primary difference lies in the fact that in active im- 
age sensors, the pixel is also provided with an intensifier. This reduces 
the spreading of the charge of capacitors in the integrating image sen- 
35 sor to the next capacitors at the stage of measuring the charge, which 
may distort the measuring results in passive image sensors. 
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Irrespective of the type of the image sensor, the digitised values of the 
pixels are transferred for further processing typically in analog form, 
pixel by pixel. Thus, the image field is scanned for example line by line, 
starting from the first pixel on the first line. The analog image signal can 
5 be sent to be displayed e.g. by an analog display device. At the stage 
of further processing, the analog image signal can be converted to 
digital form e.g. for storage in an image memory, whereby the digital 
value formed from the analog signal of each pixel is stored in a memory 
location corresponding to the pixel in question. The image signal can be 
10 subjected to e.g. filtering and noise suppression, if necessary. 

In currently known camera modules comprising an image sensor and 
control logic, the image information can be read either in analog form, 
whereby the signal must be subjected to analog/digital conversion for 

15 further processing steps, or readily converted in parallel digital form. 
Further, the synchronisation of image information is conducted by the 
control logic of the camera module in a predetermined image format, 
whereby typically a standard quantity of information must be transferred 
from each image. The quantity of information for one image depends on 

20 the number of pixels in the image sensor, /.a the resolution, and the 
accuracy of the analog/digital conversion of each pixel. For example, in 
an image sensor consisting of 480 horizontal lines and 640 vertical 
lines, thereby comprising 307 200 pixels, each of which is subjected to 
analog/digital conversion of 8 bits, the total information of one image 

25 amounts to 2 457 600 bits. 

When such a camera module of prior art is connected to a portable 
electronic device, such as a mobile station, one problem is the greater 
space needed by the parallel bus solution, compared with using a serial 

30 bus for the transfer of image information. In a typical application, infor- 
mation of 8 bits per pixel is used in a black-and-white image and infor- 
mation of 24 bits per pixel in a colour image, whereby at least 8 parallel 
transfer lines are needed. When a separate camera module is used, 
the coupling cable to be connected with the parallel bus should com- 

35 prise conductors for each line of the parallel bus and also a ground 
conductor and possibly a power supply conductor for the camera 
module, whereby the coupling conductor becomes considerably more 
expensive and stiffer to use than a coupling cable of a serial bus con- 
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taining fewer conductors. Furthermore, possible capacitive coupling 
between signal transfer lines in the parallel bus may cause cross-talk 
between adjacent conductors. Cross-talk is easily increased when the 
length of the conductors is increased. Furthermore, parallel data 
5 transmission complicates the structure of the device to be connected to 
the camera module and increases the manufacturing costs. 

The use of a serial bus in solutions of prior art would typically require 
increasing the data transfer rate at least 8 times compared with data 

10 transfer in parallel form, if the aim is to transfer the same quantity of 
information in the same time. This is not always possible, because fast 
digital signals have very sharp edges, i.e. the rise and fall times of the 
signal are very short, whereby they easily induce disturbances in the 
operation of the electronic device as well as other electronic devices. 

15 Also, signals containing rapid changes are susceptible to distortions 
which may affect the reliability of the data transfer. 

One disadvantage with present camera modules is their inflexibility; 
they produce an image in a determined form at a rate determined by 

20 the camera module itself. Information produced by camera modules of 
prior art cannot be easily affected, whereby it may be necessary to 
conduct unnecessary functions in the device receiving the image signal 
particularly when the quantity of image information entering the receiv- 
ing device exceeds the quantity that can be utilised in the receiving de- 

25 vice, whereby transferring the unutilised image information consumes 
power to an unnecessary degree. Some camera modules of this kind 
provide the option of adjusting how often a new image is transferred 
from the camera module. However, the quantity of information in each 
image is not changed. If the receiving device cannot process all images 

30 at the set updating rate but controls the camera module to transfer im- 
ages at a slower rate, the updating rate may sink to such a low level 
that it can be detected in the image e.g. as discontinuous movement. 

In several digital cameras, an LCD display device is presently used for 
35 displaying image information. This display device is used both as a 
viewfinder for directing the camera to the desired photographic subject 
and for observing the picture taken, whereby the picture can be taken 
again, if necessary. Display devices of this kind are typically analog, 
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whereby the image signal is in analog form. When used as a 
viewfinder, the image displayed with a display device must be updated 
at a sufficient rate. The frequency of updating the image is limited by 
the large quantity of image information to be transferred and the limited 
5 transfer rate. This results in discontinuous movement of the image to 
be displayed on the display device, particularly during movement of the 
camera or the photographic subject. Also in several video cameras, an 
analog LCD display device is currently used as a viewfinder, whereby 
the problems are similar during video recording. 

10 

It is an aim of the present invention to provide an improved method for 
transferring image information e.g. to an electronic device, and a cam- 
era module from which image information can be transferred in serial 
form from an electronic device which may also control the transfer of 

15 the image. In addition, the image format can be modified according to 
the need. The method of the invention is characterised in what will be 
presented in the characterising part of the appended claim 1 . The cam- 
era module of the invention is characterised in what will be presented in 
the characterising part of the appended claim 7. Furthermore, the 

20 mobile station of the invention is characterised in what will be presented 
in the characterising part of the appended claim 13. The invention is 
based on the idea that image information is transferred in serial form to 
an electronic device at a rate determined by the same. Furthermore, 
the quantity of image information to be transferred can be adjusted, 

25 whereby e.g. in viewfinder mode it is possible to display images with 
less image information at a sufficient rate so that disturbing jerky 
movement is not shown in the image to be displayed on a display 
device. When taking the final picture, the quantity of image information 
is raised to a desired level. 

30 

The present invention gives significant advantages compared with prior 
art. In a camera implemented by the method of the invention, the 
viewfinder mode and video recording can be implemented so that the 
image follows the movements of the camera or the imaging object. In 
35 simple photography, the final photograph can be, nevertheless, taken 
with a resolution which is as high as that possible in cameras of prior 
art. In video recording, a sufficient image quality is obtained in normal 
situations. Using the camera module of the present invention, the size 
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and power consumption of the electronic device can be made smaller 
than when using camera modules of prior art. Moreover, the solutions 
for transferring image information according to the invention do not 
require increasing the signal transfer rate, whereby the number of 
5 disturbances can be kept significantly smaller than is possible when 
using solutions of prior art, the image transfer rate being the same. 

Furthermore, the present invention gives the advantage that the data 
transfer bus between the camera module and the electronic device can 
10 be made simpler and the connection means for connecting the camera 
module can be made simpler in the electronic device. 



In the following, the invention will be described in more detail with ref- 
erence to the appended drawings, in which 

15 

Fig. 1a shows functional blocks of a camera module according to a 
preferred embodiment of the invention, 

Fig. 1b shows the camera module according to a preferred 
20 embodiment of the invention in a reduced block chart, 



Fig. 2a shows the connection of the camera module according to a 
preferred embodiment of the invention as a separate device 
to a mobile station, and 

25 

Fig. 2b shows the integration of the camera module according to a 
preferred embodiment of the invention in a mobile station. 



Figure 1a shows functional blocks of a camera module according to a 
30 preferred embodiment in a reduced manner. For the photoelectronic 
conversion of the image, the camera module 1 has an image sensor 2 
which in this example is a non-integrating CMOS image sensor, but the 
invention can also be applied in other types of image sensor, such as 
integrating CMOS image sensors and CCD image sensors. The 
35 resolution of the image sensor 2 is for example 640 x 480, but the 
resolution as such has no significance in applying this invention. For 
clarity, not all pixels are shown in the drawings but as examples the first 
pixel P1 ,1 , the second pixel P2.1 and last pixel Pm,1 of the first line, the 
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first pixel P1,2 of the second line, and the last pixel Pm.n of the last line 
are illustrated. A line selector 3 is used to select the pixel line to be 
examined at a time, and a column selector 4 is used to select the 
desired pixel P1 ,1 — Pm,n of the line selected by the line selector 3, the 
current generated by the pixel being conducted to the output 5 of the 
column selector 4. Thus, the output 5 of the column selector contains 
the current generated by the selected pixel P1.1 — Pm.n which is 
proportional to the intensity of light to which said pixel P1 ,1 — Pm,n is 
exposed at the moment of reading. When using an integrating image 
sensor or a CCD image sensor, the charge is proportional to the 
intensity of the light to which the pixel P1,1 — Pm,n is exposed and to 
the exposure time, whereby a means is also required to discharge each 
pixel P1 ,1 — Pm.n. As mentioned earlier in this description, it is not easy 
to implement addressing of single pixels P1.1 — Pm.n in CCD image 
sensors and integrating CMOS image sensors, but in other respects, 
the operation of the camera module 1 according to the invention is 
essentially similar to that when using a non-integrating image sensor 2. 

The output 5 of the column selector is coupled to a sample and hold 
circuit 6. The output voltage of the sample and hold circuit 6 is set at 
the moment of sampling substantially the same as the input voltage of 
the sample and hold circuit 6. This output voltage is kept substantially 
constant until the next sampling instant or during the holding time of the 
sample and hold circuit 6. With this sample and hold circuit 6, it is pos- 
sible to keep the measuring voltage supplied to the analog/digital con- 
verter 7 for the time required for analog/digital conversion, whereby the 
analog/digital conversion is as reliable as possible. If necessary, the 
digital conversion result of the analog/digital converter 7 is sent to a 
pre-processing block 8 where the image information can be subjected 
to some conversion and/or filtering operations, such as conversion of 
colour image format, conversion of image information for different dis- 
play devices, and image undersampling. 

If the image sensor 2 is intended for taking colour images, each pixel 
p-jj — p m) n can consist of three partial elements for different colour 
components. Typically, a so-called RGB image format (red, green, 
blue) is used, whereby each colour component can be subjected to a 
separate photoelectric conversion. This can take place for example by 
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arranging a red filter in front of the pixel measuring the red colour 
component, preventing the pixel from being exposed to light at 
substantially other than red wavelengths; in a corresponding manner, a 
green filter is arranged in front of the pixel measuring the green colour 

5 component, and a blue filter is arranged in front of the pixel measuring 
the blue colour component. In the final image, one dot consists of these 
three pixels. These pixels corresponding to different colour components 
can be placed side by side for example on the same line or in the form 
of an isosceles triangle. Thus, for determining one dot, it is necessary 

10 to examine the signal formed by three pixels. This can be done e.g. so 
that the analog/digital conversion is conducted in the camera module 1 
for each colour component one after the other using the same sample 
and hold circuit 6 and analog/digital converter 7. In another alternative, 
separate sample and hold circuits and analog/digital converters are 

15 arranged for each colour component. Thus, each colour component is 
further provided with a selector, preferably a column selector 4. 

Furthermore, colour image sensors have been developed in which the 
number of pixels is the same as in a monochrome image sensor. This is 

20 achieved e.g. in a way that every other pixel is a pixel measuring green 
light, every fourth one is a pixel measuring red light and every fourth 
one a pixel measuring blue light. This is based on the capacity of the 
human eye; the sensitivity to different colours is different. Information 
given by the green pixel can be used as luminance information almost 

25 directly. In the final image signal, for example a group of four pixels is 
used to form the image signal of one dot. These methods are disclosed 
in more detail e.g. in patents US-4,642,678 and US-4,630,307. 

The conversion of colour format e.g. from the RGB colour format to a 
30 so-called YCbCr format can be conducted by calculation as follows: 
(1a) Y = 0.299 R + 0.587 G + 0.1 14 B 

(1b) Cb=— 0.168 R — 0.331 G + 0.5 B 
(1c) Cr = 0.5 R — 0.41 87 G— 0.0813 B 

35 The luminance component Y indicates the grey tones of the image, and 
this can be used e.g. in displaying a black-and-white image and in dis- 
playing a colour image as a black-and-white image. There are two 
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chrominance components, Cb and Cr, which contain the colour infor- 
mation of the image. 

From the pre-processing block 8, the image information is transferred to 
5 the memory 18 of the camera module. From the memory 18, the image 
information can be transferred to a parallel/series converter 9 where the 
digitised image information of each pixel P1.1 — Pm,n is converted to 
serial form. The image information can thus be read in serial form from 
a serial connection bus 1 0. As the data transfer format in this serial 
10 bus, it is possible to use serial data transfer formats known as such, for 
example in a way that the image information of 8 bits is framed with 
initial and terminal bits. The transfer of the image information is 
advantageously controlled by the electronic device, as will be disclosed 
below in this description. 

15 

For controlling the above-mentioned functional blocks, the camera 
module 1 is further provided with a control block 1 1 , which in this 
preferred embodiment includes four control registers 12 to 15 and a 
timing block 33. A sample register 12 determines at which moment the 

20 sample and hold circuit 6 takes a sample from the output 5 of the col- 
umn selector. A quality register 13 determines the accuracy of the con- 
version to be conducted by the analog/digital conversion. A pre-proc- 
essing register 14 determines whether an image format conversion is to 
be conducted in the pre-processing block 8 and also whether image 

25 information in digital form is to be undersampled. The parallel/serial 
converter 9 is further provided with a parallel/serial conversion regis- 
ter 15 which controls data transfer on the serial bus 10. The control 
block also takes care of the operations needed for taking a picture, 
such as resetting the charges of the pixels P1,1 — Pm,n and timing the 

30 measurement of the charges of the pixels P1 ,1 — Pm,n. 

A control serial bus 16 is connected to the control block 1 1 of the cam- 
era module 1 e.g. for transferring control commands and parameters to 
the control block 11. The control block 11 comprises further means (not 
35 shown) for controlling the line selector 3 and the column selector 4. 

Figure 1b shows a camera module 1 according to an advantageous 
embodiment of the invention in a reduced block chart. In the camera 



11 



module 1 of Fig. 1b, e.g. the pre-processing block 8, the parallel/serial 
converter 9 and the control block 11 of Fig. 1a are implemented in the 
digital signal processing unit 17 (DSP). In Fig. 1b, the image sensor 2 
and the line selector 3 and column selector 4 are shown in one block 2'. 
5 In a corresponding manner, the sample and hold circuit 6 and the 
analog/digital converter? are shown in one block 7. The signal 
processing unit 17 is provided with a memory 18, preferably at least a 
random access memory RAM, e.g. for temporary data storage. 
Furthermore, the memory 18 contains the control commands or the like 

10 required for controlling the operation of the digital signal processing 
unit 17. The memory 18 is coupled via a memory connection block 19 
to the system bus 20 of the digital signal processing unit. The system 
bus 20 includes a data bus, an address bus and a control bus, but 
these are not shown separately, and the practical implementation of 

1 5 these buses is prior art to someone skilled in the art. 

The digital signal processing unit 17 further comprises a serial connec- 
tion circuit 21 . It includes a parallel/serial conversion block for the in- 
formation to be transmitted to the serial bus 10, as well as for convert- 
20 ing serial form control information from the control serial bus 16 into 
parallel form for transmission to the system bus 20. 

The signal processing and control block 22 of the digital signal process- 
ing unit 17 controls the image sensor 2' for reading the image informa- 

25 tion of the pixels P1.1 — Pm,n. This is conducted advantageously so 
that in the selection lines of the line selector, which are shown as one 
line and indicated by the reference RSEL in Fig. 1 a, the binary value is 
set to correspond to the desired line of the image; to select the first line, 
the value 0; to select the second line, the value 1, etc. Furthermore, an 

30 output enabling line OE1 is conducted to the line selector, to change 
the state of the line selection line corresponding to the binary value set 
in the selection lines to another logical state, e.g. logical 0 state. Thus, 
the logical 1 state corresponds to a situation where the line is not 
selected. In the logical 0 state, the first connection interface (conductor) 

35 of the pixels coupled to said line is set close to 0 V. In a corresponding 
manner, in the selection lines SSEL of the column selector, the binary 
value is set to correspond to the column to be examined. As a result, 
the input line of the column selector, connected to the corresponding 
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column lines of the image sensor, is coupled to the output line 5 of the 
column selector, whereby the signal of this line 5 corresponds to the 
signal of the selected pixel, which can be converted into digital form. 

5 Figure 2a shows the connection of a camera module 1 according to a 
preferred embodiment of the invention as a separate module to an 
electronic device, preferably a mobile station 23, by means of an 
external connection bus 24. The external connection bus 24 comprises 
a serial bus 10 and a control serial bus 16, whereby control information 

1 0 can be transferred from the mobile station 23 to the camera module 1 
and image information can be transmitted from the camera module 1 to 
the mobile station 23, respectively. The mobile station 23 is provided 
e.g. with a control unit 25 comprising advantageously a microprocessor 
CPU or a corresponding processor, a memory 26 and a serial connec- 

15 tion block 31 (serial input/output) for coupling the external connection 
bus 24 to the mobile station 23. For example the serial/parallel con- 
versions between the external serial bus 24 and the system bus 24 of 
the mobile station take place in the serial connection block 31. The 
memory 26 can be used e.g. for storing image information read from 

20 the camera module 1 , whereby the image can be displayed for example 
with a display device 27. One advantage of this separate camera mod- 
ule 1 is that the same camera module 1 can be used in connection with 
different electronic devices equipped with the required connection 
means for connecting the external connection bus 24 with the electronic 

25 device. The external connection bus 24 can consist of conductors, or it 
can be implemented e.g. with infrared data transmission means. 

Figure 2b shows a solution in which the camera module 1 according to 
the invention is integrated in the mobile station 23. Thus, an internal 

30 serial connection bus 28 is arranged between the camera module 1 and 
the control block 25 of the mobile station, to transfer control and image 
information between the camera module 1 and the control block 25 of 
the mobile station. The internal serial bus 28 is coupled to the serial 
connection block 31 of the mobile station which performs e.g. the 

35 serial/parallel conversions between the serial bus 28 and the system 
bus 32 of the mobile station. Using this integrated solution, it is possible 
to achieve a relatively compact mobile station 23 also equipped with the 
camera function. This has the advantage that no separate external 
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connection bus is needed between the camera module 1 and the 
control block 25 of the mobile station, and that the use of such an 
integrated device is in many situations easier than the use of two sepa- 
rate devices. 

5 

In the following, the operation of the method according to the invention 
will be described. It is assumed that the camera module 1 is intended 
for taking single photographs, corresponding to a normal digital photo- 
graphic camera, and that the image sensor 2 is a non-integrating 

10 CMOS image sensor. When preparing for taking a picture, the camera 
module 1 is set to viewfinder mode, whereby image information of the 
camera module 1 is displayed on the display device 27, so that the user 
can direct the camera module 1 to the desired photographic subject 
and perform cut-out operations, if necessary. The optics of the camera 

15 module 1 can, in a manner known as such, comprise various objec- 
tives, exchangeable objectives and zoom objectives, but these will not 
be discussed in more detail in this context. The user sets the camera 
module 1 to viewfinder mode preferably by using the keypad 29 of the 
mobile station 23. The control block 25 of the mobile station interprets 

20 the button pressing and starts to set the function mode of the camera 
module 1 . To set the function mode, the control block 25 of the mobile 
station sends the required control commands and parameters to the 
control block 1 1 of the camera module 1 . These control commands 
contain the setting of registers according to predetermined parameters. 

25 For example, a command for taking a picture is set in the sampling 
register 12. In the quality register 13, the conversion accuracy is set for 
the analog/digital conversion of each sample, which may vary 
preferably from 1 to 8 bits in practical applications. In some cases, it 
may also be necessary to use a greater conversion accuracy. In 

30 viewfinder mode, the conversion accuracy is set smaller than in the 
actual photography mode, for example 4 bits instead of 8 bits. As a re- 
sult, the analog/digital conversion converts the sample at an accuracy 
of four most significant bits (MSB), whereby the conversion is also 
faster than when using a greater conversion accuracy. In a converter 

35 based on sequential approximation, reduction of the conversion accu- 
racy to a half means doubling of the conversion rate. With four bits, it is 
possible to present 16 different values, but this is a sufficient accuracy 
in viewfinder mode. Furthermore, an increase in the conversion rate 
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means that in the same time it is possible to transfer the image 
information of several pixels P1,1 — Pm,n, whereby, as a result, the 
image can be updated more often on the display device 27. 

5 Moreover, if desired, it is possible in the pre-processing register 14 to 
set information on whether the image information is to be subjected to a 
conversion, e.g. conversion of colour format. Furthermore, it is possible 
in the pre-processing register 14 to set information on undersampling, 
which means, for instance, that not all results of analog/digital conver- 

1 0 sion are transferred further but for example every second one, or only 
the value of every other pixel is converted, which will also increase the 
updating rate of image information. Undersampling reduces the resolu- 
tion of the image, but, it is possible, if necessary, in the receiving device 
to form an image corresponding to the original resolution from the 

15 undersampled image, e.g. by interpolation on the basis of the received 
image information. 

Furthermore, information is transferred from the control block 25 of the 
mobile station to the control block 1 1 of the camera module about the 

20 moment for taking the picture. This command can be transmitted by the 
mobile station 23 for example after the previous image has been proc- 
essed. This applies particularly to non-integrating image sensors. The 
command for taking the picture can also be transmitted in advance, if 
taking the picture requires a longer exposure time, e.g. when an inte- 

25 grating sensor is used. Thus, after the transmission of the command for 
taking the picture, the mobile station 23 has sufficient time for proc- 
essing the image under processing, before the camera module 1 takes 
a new picture, and unnecessary waiting for processing of the image can 
be avoided. 

30 

After the camera module has received the command for taking a pic- 
ture, the control block 1 1 interprets the command and starts taking the 
picture. The control block 1 1 generates control signals for the line se- 
lector 3 and the column selector 4 to select the pixels P1,1 — Pm,n 
35 preferably in a way that one image is read as quickly as possible to 
eliminate e.g. movement distortions in the image. The pixels are read 
for example in the following way. After receiving the necessary control 
commands and parameters, the control block 1 1 of the camera module 
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sets preferably the first pixel line of the image sensor 2 for reading, with 
the line selector 3. Next, with the column selector 4, the control 
block 1 1 selects the first column, whereby the current of this pixel is 
present at the output 5 of the column selector and is transferred to the 
sample and hold circuit 6. It may take a certain setting time to make the 
current value constant in the output 5 of the column selector before the 
control block 1 1 commands the sample and hold circuit 6 to sample this 
current. The setting time is advantageously some tens of nanoseconds. 
After the sample and hold circuit 6 has taken the sample, the control 
block 11 commands the analog/digital converter to start an 
analog/digital conversion at a precision determined in the quality 
register 13. The analog/digital converter? typically comprises a status 
line or the like, by means of which the control block 1 1 can monitor the 
completion of the analog/digital conversion. After completion of the 
analog/digital conversion, the control block 1 1 transfers the conversion 
result to the pre-processing block 8 and performs pre-processing, if 
necessary. After this, the image information of the pixel is stored in the 
memory 1 8 of the camera module 1 , in a memory space allotted to the 
selected pixel. Next, the control block 1 1 sets in the column selector 4 
information whereby the column selector 4 selects the current of the 
next pixel into the output 5. This current value is subjected to the same 
operations as presented above. After conversion of the pixels in the 
whole line, the control block 11 selects the next line to be converted, 
with the line selector 3. After the whole image field has been scanned, 
the image information is stored in the memory 18 and ready to be 
transferred. This transfer can be implemented e.g. in a way that the 
camera module 1 transmits information about the completion of the 
conversion result of the image to the serial bus 10, whereby the control 
block 25 of the mobile station transmits a command to start image 
transfer to the control serial bus 16, if the mobile station 23 is ready to 
receive the image information. After this, the control block 1 1 transfers 
the conversion result of the first pixel from the memory 18 to the 
parallel/serial converter 9, where the conversion result is converted into 
serial form and transferred to the serial bus 10. If necessary, it is also 
possible at this stage to reduce the quantity of information to be 
transmitted by leaving some of the less significant bits untransferred. 
The control block 25 of the mobile station receives this information and 
conducts serial/parallel conversion on the same, and transfers the 
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information to the memory 26 of the mobile station, to a memory 
location reserved for the selected pixel. Next, the information on the 
second pixel is transferred, and so forth, until the whole image has 
been transferred. 

5 

Next, the control block 25 of the mobile station for example displays the 
image on a display device 27 by transferring the image information from 
the memory 26 to the display device 27, where the image information is 
displayed at a location reserved for it. If the display device 27 is an 
10 analog display device, the image information is further subjected to 
digital/analog conversion before transferring to the display device 27. 

When necessary, it is possible to crop a smaller area (window) from the 
image to be transferred to the mobile station 23. This is conducted 

15 preferably by sending the co-ordinates of two opposite edge points (line 
and column identifications) of the area to be transferred, together with 
information on the desired conversion accuracy and resolution of the 
image. Also in this situation, the camera module takes preferably a full 
picture and stores it in the memory, but only the image information on 

20 the desired area is transmitted to the serial bus 10. 

Furthermore, the invention can be applied in a way that the camera 
module 1 always takes a picture with the maximum resolution and 
conversion accuracy and stores the image in the memory 18. Thus, the 
25 resolution and/or conversion accuracy is reduced at the stage of 
transferring information to the serial bus 10. 

In viewfinder mode, the quantity of image information per image to be 
transferred is smaller than in normal photographic mode; consequently, 

30 images can be updated at a faster rate than when using solutions of 
prior art. Thus, the image is updated faster, and jerky movement cannot 
be noticed to a significant degree. Nevertheless, the final photograph 
can be taken with a higher resolution, whereby the control block of the 
mobile station transmits the required control commands and 

35 parameters to the control block 1 1 of the camera module 1 . Taking a 
picture in this way can be implemented for example so that the user 
presses a predetermined button in the keypad 29 of the mobile station. 
Thus, the camera module 1 conducts conversion of the image at a 
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higher resolution, and after completion of the conversion, the camera 
module 1 transmits the serial bus 10 information about the completion 
of the image, whereby the control block 25 of the mobile station can 
start the transfer of the image information. In this case, the transfer of 
5 the image information takes a longer time than in the viewfinder mode, 
but, on the other hand, it is not significant. 

The camera module 1 of the invention has the further advantage that 
image information can be transferred asynchronously in relation to the 

10 functions of the camera. Thus, the camera module 1 of the invention 
can be controlled in a way that it generates an image of the desired 
type, whereby it is possible, if necessary, to reduce the quantity of im- 
age information to be transferred. In camera modules of prior art, the 
image format and resolution can be changed, but the transfer of image 

15 information takes place at a constant rate determined by the camera 
module, whereby typically either a parallel bus or a fast serial bus is 
needed for transferring the information at a sufficient rate from the 
camera module to further processing stages. 

20 Moreover, the camera module 1 of the invention can also be utilised in 
video recording, whereby each single image consists of a smaller 
quantity of image information than in camera modules of prior art, but 
the updating rate of the images can be raised, whereby a more realistic 
moving image is obtained. Also, pictures taken with the camera 

25 module 1 of the invention can be transmitted via a mobile 
communication network, if necessary. Thus, with reference to the block 
diagram of Fig. 2a/2b, the control block 25 of the mobile station reads 
the images in ways presented above and transfers the image 
information further to a radio element 30, from which the image 

30 information can be transmitted via a mobile communication network 
(not shown) to another mobile station or telecommunication terminal. 
Thus, the image information can be presented in the receiving 
telecommunication terminal. If necessary, the control block 25 of the 
mobile station compresses the image to be transferred to the radio 

35 element, whereby the data transmission can be enhanced in the mobile 
communication network. Because the processing of the image takes 
place primarily already in the camera module 1, the control block 25 of 
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the mobile station does not need to have such a large processing 
capacity as when camera modules of prior art are used. 

The present invention is not limited solely to the embodiments pre- 
sented above, but it can be modified within the scope of the appended 
claims. 
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Claims : 

1 . A method for transferring image information from a camera mod- 
ule (1) to an electronic device, such as a mobile station (23), in which 

5 camera module (1) an image is formed by an image sensor (2) compris- 
ing pixels where the light to which the pixels (P1,1 — Pm,n) are exposed 
is converted into an analog signal which is converted into digital image 
information, characterised in that the image information is transferred 
in serial form and that the transfer of the image information is controlled 

1 0 from the electronic device (23). 

2. The method according to claim 1, characterised in that the quan- 
tity of the image information to be transferred from the camera module 
(1) can be adjusted. 

15 

3. The method according to claim 2, characterised in that the ad- 
justment of the quantity of image information to be transferred from the 
camera module (1) is conducted by adjusting the conversion accuracy 
of the analog/digital conversion. 

20 

4. The method according to claim 2 or 3, characterised in that the 
adjustment of the quantity of image information to be transferred from 
the camera module (1) is conducted by adjusting the resolution of the 
image. 

25 

5. The method according to claim 4, characterised in that the ad- 
justment of the resolution of the image is conducted by undersampling 
of the image information. 

30 6. The method according to claim 4 or 5, characterised in that in the 
electronic device (23), the resolution is restored by interpolation from 
the received image information. 

7. A camera module (1) comprising an image sensor (2) with pixels 
35 (P1,1 — Pm,n) for conducting photoelectric conversion, and means (6, 
7) for conversion of the analog signal generated by said pixels into 
digital form, characterised in that the camera module (1) further 
comprises means (10) for transferring digital image information to an 
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electronic device, such as a mobile station (23), in serial form, and 
means (11, 16) for conducting the transfer of the image information 
under control by the electronic device (23). 

5 8. The camera module (1) according to claim 7, characterised in 
that it further comprises means (11) for adjusting the quantity of image 
information to be transferred from the camera module (1). 

9. The camera module (1) according to claim 8, characterised in 
10 that said means (11) for adjusting the quantity of image information to 

be transferred from the camera module (1) comprise means (13) for 
adjusting the conversion accuracy of the analog/digital conversion. 

10. The camera module (1) according to claim 8 or 9, characterised 
15 in that said means (11) for adjusting the quantity of image information 

to be transferred from the camera module (1) comprise means (15, 33) 
for adjusting the resolution of the image. 

11. The camera module (1) according to claim 10, characterised in 
20 that said means (33) for adjusting the resolution of the image comprise 

means (12, 13) for undersampling of the image information. 

12. The camera module (1) according to any of the claims 8 to 11, 
characterised in that said means (11) for adjusting the quantity of im- 

25 age information to be transferred from the camera module (1) comprise 
means (15) for undersampling of the image information formed in the 
camera module (1). 

13. A mobile station (23), characterised in that it comprises: 

30 — means (10) for connecting a camera module (1), the camera 
module (1) comprising an image sensor (2) with pixels (P1,1 — 
Pm,n) for conducting a photoelectric conversion, and means (6, 7) 
for converting the analog signal generated by the photoelectric 
conversion means to digital form, and 

35 — means (24, 25) for controlling the transfer of image information 
formed by the camera module (1), and 
— means (24) for transferring the image information formed by the 
camera module (1) to the mobile station (23) in serial form. 
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14. The mobile station (23) according to claim 13, characterised in 
that it further comprises means (11) for adjusting the quantity of image 
information to be transferred from the camera module (1). 
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Abstract 

The invention relates to a method for transferring image information 
from a camera module (1) to an electronic device, such as a mobile 

5 station (23). In the camera module (1), an image is formed by an image 
sensor (2) comprising pixels, where the light to which the pixel (Pl,1 — 
Pm,n) is exposed is converted into an analog signal which is converted 
into digital image information. The image information is transferred in 
serial form, and the transfer of the image information is controlled by 

1 0 the electronic device (23). 
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of the prior US. or PCT application^) under 35 U.S.C. § 120. 
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(list name and registration number) 

Clarence A, Green C24,622) 
Harry F. Smith /32,493) 
Mark F. Harrington C31,686) 

(check the following item, if applicable) 
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of the above-named attorney(s) to accept and follow instructions from my 
representative®. 
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Clarence A. Green 
Perman & Green, LLP 
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